Web Survey Bibliography
Studies have shown that various features of the presentation of the response options can affect the distribution of the answers. For example, as work by Schwarz has shown, the numerical labels attached to the scale points can change the apparent meaning of the options; similarly, the colors assigned to the different scale points seems to affect the answers respondents give. In this study, we examine the impact of the spacing of the response options on their relative popularity. In a randomized experiment embedded in a Web survey, we systematically varied the spacing of the options in a series of items using a five-point agreement scale. For some respondents, the scale endpoints were given more space in the scale than the three middle points. For another group of respondents, the scale midpoint (indicating neutrality) was given more space. Finally, for a third group of respondents, the scale points were evenly spaced. We thought that giving an option more space would increase its visual prominence and that this increased prominence would increase the likelihood that respondents would select the option. The results are generally in line with the visual prominence hypothesis. When the extreme options were given more space, respondents were more likely to select; this effect was apparent for four of the six items (and in several analyses across items). The effect of giving the neutral midpoint more space was less clear; only one of the six items shows a significant increase in the popularity of the neutral response when that option was more prominent. This may reflect the relative rarity of such responses. This is one of several studies demonstrating the importance of the visual prominence of information in Web surveys.
Homepage (abstract)
Web survey bibliography (4086)
- Statistical Foundations of Cell-Telephone Surveys; 2008; Wolter, K., Smith, P.
- Wireless-Mostly Households: Estimates from the 2007 National Health Interview Survey; 2008; Blumberg, S. J., Luke, J. V.
- The Impact of the Spacing of the Scale Options in a Web Survey; 2008; Kennedy, C., Tourangeau, R., Conrad, F. G., Couper, M. P., Redline, C. D.
- Experiments in Visual Survey Design for Mobile Devices; 2008; Peytchev, A., Hill, C.
- Computing Metrics for Online Panels; 2008; Callegaro, M., DiSogra, C.
- 2006 Canadian Census Internet Mode Effect Study; 2008; Grondin, C., Sun, L.,
- Mode Effects on In-Person and Internet Surveys: A Comparison of the General Social Survey and Knowledge...; 2008; Smith, T. W., Dennis, J. M.
- Cell Phone Survey Sampling and Weighting; 2008; Battaglia, M. P.
- An Analysis of Mode Effects in Three Mixed-Mode Surveys of Veteran and Military Populations; 2008; Rachev, B., Yang, M., Davis, D., Szoc, R.
- Cell Phone–Only Household in a National MailSurvey: Who Are They?; 2008; Han, D., Cantor, D.
- Statistical Challenges Facing Cell Phone Surveys; 2008; Battaglia, M. P., Frankel, M. R.
- Cell Phone–Only Research at Arbitron: Statistical Analyses; 2008; Griffi, R.
- Identifying Nonresponse Bias Using a Survey Subset in Follow-Up; 2008; Gordek, H., Lynch, J., Chen, P., Morgan, T.
- Surveying Cell Phone Numbers in the United States; 2008; Lavrakas, P. J.
- Redesigning the American Community Survey (ACS): Computer-Assisted Personal Interview Sample; 2008; Castro, E. C., Hefter, S.
- Using Paradata to Actively Manage Data Collection; 2008; Laflamme, F., Pasture, T., Talon, J., Maydan, M., Miller, A.
- Survey Respondent Incentives: Research and Practice; 2008; Groves, R. M., Harris-Kojetin, L., Kulka, R. A., Mooney, G.
- Internet Surveys: Can Statistical Adjustments Eliminate Coverage Bias?; 2008; Dever, J. A., Rafferty, A., Valliant, R. L.
- Summary Report of a Survey of Learning Space Design in Higher Education; 2008; Grummon, P.
- Join the research - participant-led open-ended questions ; 2008; Verhaeghe, A., De Ruyck, T., Schillewaert, N.
- Optimising the language of email survey invitations; 2008; Moskowitz, H., Martin, B.
- How to Conduct Surveys: A Step-by-Step Guide; 2008; Fink, A.
- What's Really Important?; 2008; Grapentine, T., Teas, K. R.
- Top concerns for our industry; 2008; Grapentine, T.
- Surveys by Design; 2008; Hopewell, N.
- Measuring social desirability in web surveys through client-side paradata ; 2008; Van Acker, F., Theuns, P.
- Comparing the Reliability of Responses to Telephone-Administered versus Self-Administered Web-Based...; 2008; Rankin, K. M., Rauscher, G. H., McCarthy, B., Erdal, S.
- Can the internet replace postal surveys?; 2008; Sullman, M.
- Maximising response rates in household telephone surveys; 2008; O'Toole, J., Sinclair, M., Leder, K.
- Web Mining: A Survey Of Current Research, Techniques, And Software; 2008; Zhang, Q., Segall, R. S.
- Does a Probability-Based Household Panel Benefit from Assignment to Postal Response as an Alternative...; 2008; Rookey, B. D., Hanway, S., Dillman, D. A.
- Panel surveys go mobile; 2008; Weber, M., Denk, M., Oberecker, K., Strauss, C., Stummer, C.
- How accurate are self-selection web surveys?; 2008; Bethlehem, J.
- Antecedents of Anonymity Perceptions in Web-based Surveys; 2008; Whelan, T. J.
- Internet Research: Developments, problems, and potential; 2008; Welker, M., Matzat, U.
- Longitudinal tracking of voter perceptions during the 2007-2008 election cycle using a probability-based...; 2008; Tompson, T., Lawrence, M., Subias, S.
- Individual payments as a longer-term incentive in online panels ; 2008; Goeritz, A., Wolff, H.-G., Goldstein, D. G.
- Universal Design for Web Surveys: Practical Guidelines; 2008; Matulewicz, H., Coburn, J.
- An Iranian Experience of Internet Surveys; 2008; Khoshgooyanfard, A. R.
- Developing the Online Survey ; 2008; Gordon, J. S., McNew, R.
- Online image quality surveys based on response time; 2008; Rasmussen, D. R.
- Eliciting Subjective Probabilities in Internet Surveys; 2008; Delavande, A., Rohwedder, S.
- A Comparison of Item Nonresponse in Web and Pen-and-Paper Surveys of Sexual Behaviour; 2008; Evans, A. R., Elford, J., Bolding, G., Wiggins, D.
- Parallel Phone and Web-based Interviews: Effects of Sample and Weighting on Comparability and Validity...; 2008; Thomas, R. K., Krane, D., Taylor, H., Terhanian, G.
- Modern Telephony, the Web and Survey Management; 2008; Olsen, R. J.
- Mobile Web Survey Design; 2008; Peytchev, A. Hill, C.
- Impact of new technologies in data collection methods; 2008; Callegaro, M.
- Integration of the web into survey data collection: Balancing costs and errors; 2008; Vehovar, V., Berzelak, N., Lozar Manfreda, K.
- Response Non-Differentiation and Response Styles in Web-Based Studies: Causes and Consequences ; 2008; Frisina, L. T., Thomas, R. K.
- Communicative Channels, Cognitive Processes and Question Understanding: Results from a Randomized Field...; 2008; Fuchs, M.